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Executive  Summary 


This  report  focuses  on  the  results  of  research  efforts  on  methodologies  and  the 
Advanced  Field  Artillery  System  (AFAS).  Our  goal  was  to  conceptualize  and  design 
alternative  AFAS  capabilities  in  the  Janus  combat  simulation  to  evaluate  their  effectiveness  on 
tomorrow's  battlefield  under  several  different  scenarios  and  missions.  Additionally,  the  team 
used  the  results  to  verify  a  methodology  for  predicting  combat  simulation  results  for  alternative 
sensitivity  analyses.  The  results  of  this  first  phase  indicate  a  need  for  a  faster  delivery  system 
to  mass  fires  at  the  right  time  in  the  right  place  on  the  future  battlefield. 

The  team  developed  several  scenarios  to  fully  exploit  the  effects  of  fire  support  in  the 
defense.  The  scenarios  involved  a  moving  enemy  force  against  static  defensive  friendly  units. 
We  evaluated  several  AFAS  alternatives  in  terms  of  rate-of-fire  and  time-on-target  capabilities 
on  Janus  (A).  The  AFAS  either  had  an  enhanced  rate-of-fire  or  improved  capability  for 
providing  more  rounds  in  time-on-target  missions.  We  conducted  replications  of  each  design 
matrix  to  test  for  significance  of  different  factors  or  alternatives  as  part  of  the  analysis.  Once 
all  runs  were  conducted,  data  were  collected  using  the  Janus  Enhanced  Data  Analyzer.  Next, 
the  information  was  organized  on  a  spreadsheet  to  conduct  the  factorial  design  analysis  and 
response  surface  methodology.  The  measures  of  effectiveness  and  graphical  analyses  showed 
significant  results.  The  results  indicate:  1)  Increasing  the  rate-of-fire  significantly  reduces 
the  required  amount  of  rounds  for  a  kill,  as  well  as,  a  greater  number  of  kills  for  slow  enemy 
forces;  2)  Response  surface  methodology  is  a  viable  method  for  predicting  parametric 
variations  between  factors  such  as  ROF  and  TOT.  SFC  West  also  conducted  a  1000-target 
analysis  to  determine  whether  cumulative  effects  exceeded  individual  target  effects  under  time- 
on-target  and  rate-of-fire.  The  results  indicated  that  more  rounds  per  TOT  and  more  rounds 
per  minute  for  ROF  increased  the  total  number  of  kills,  but  with  an  expected  decrease  in 
efficiency  in  terms  of  kills  per  rounds. 

As  indicated  in  appendix  A,  the  project  was  briefed  from  both  an  analytical 
methodology  standpoint  at  the  Military  Operations  Research  Symposium  and  from  an  combat 
developer's  view  to  AFAS  key  personnel  at  Fort  Sill.  The  Department  of  Systems 
Engineering  has  incorporated  response  surface  methodologies  as  a  predictive  method  into 
research  work  on  other  projects.  The  project  was  well-received  at  both  locations,  but 
transitions  to  new  assignments  by  almost  all  of  the  analysts  and  MAJ  Clark  precluded  further 
research.  Ft.  Sill's  AFAS  project  leaders  are  currently  considering  using  USMA  analysts  in 
the  latest  AFAS  Study  Plan. 


Appendix  A 

AFAS  Study  Results:  Phase  I 


AFAS  TOT/ROF 
Trade-Off  Analysis 


Purpose:  Investigate  the  Delivery  Capabilities  of  the  Advanced  Field  Artillery 
System  (AFAS)  for  enhanced  combat  effectiveness 

Scenario:  Southwest  Asia  (U.S.  Mech  Inf  Defending  vs.  T-72/BMP  force) 

Pociorsto  Investigate : 

-  Rate  of  Fire  (ROF) 

-  Time-On-Target  (TOT) 

-  Varying  Percentages  of  Soft  and  Hard  Targets 


AFAS  TOT/ROF 
Considerations 

Tjmg^on^Tsrg^i 

How  many  volleys  appear  to  be  sufficient  for  cdmbat  effectiveness? 


Bate  Qf  Firs. 

How  fast  a  rate  of  fire  is  needed  for  the  AFAS? 

Modeling.  AFAS.  in  iianus. 

-  On-Board  Technical  &  Tactical  Fire  Control 
-Automatic  Gun  System 

-  Advanced  POS/NAV 
-Advanced  Munitions  &  Propellants 


AFAS:  Study  Methodology 

-  Set  up  the  SWA  Scenario  as  Desired  By  FT  Sill 

-  Conduct  10  Runs  for  each  Design  Point 

-  Review  Battles  for  Consistency  in  Using  Indirect  Fires 

-  Graph  Measures  of  Effectiveness  for  Trends 

-  Analyze  MOE  for  Main/Interaction  Effects 

-  Predict  Middle-value  Variations  using  Response 
Surface  Methodology  (RSM) 

-  Verify  RSM  by  Running  Scenario  w/Middle  Values 


Fire  Plan 


Time  Mission 

1 :00  •  Fire  Target  AB001  to  coincide  with  execution  of  cratering 
charge  at  164610. 

3:00  -  Fire  Group  Bravo  (AB002,  AB003,  AB004)  to  bottle  the  enemy 
north  of  the  60  gridline  and  destroy  him  as  he  begins  to 
deploy  north  of  the  61  gridline. 

5:00  -  Fire  Target  AC001 ,  stationary  trucks  and  troops  in  the  open. 

7:00  -  (Scenario  1)  Fire  Targets  AD003  and  AD005  to  destroy  enemy 
armor  and  block  withdrawal  from  direct  fire  engagement  area. 

-  (Scenario  2)  Fire  Target  AD001,  moving  trucks  in  the  open. 


9:00  -  (Scenario  1)  Fire  Targets  AD003  and  AD004. 

-  (Scenario  2)  Fire  Target  AD002,  moving  trucks  in  the  open. 


Classification  of  Enemy 
Soft  and  Hard  Targets 


T-80  MBT 
T-72  MBT 
T-62  MBT 
BMP-2  IFV 
BMP-1  IFV 
BMP  CP  Veh 
BRDM-AT 


Lkflllff/jM 


Riflemen 
RPG-7 
Lt  MG 
AGS-17 
ADA  Tm 
120mm  Mtr 
152mm  How 
122mm  Mortar 
Truck  Utility 
Truck  POL 
Motorcycle 


High-Resolution  Force  Structure 
SWA  Mech  Infantry  Scenario  #1 


BLUE  SYSTEMS 


28  Ml  A1  Tank 
30  M2  Bradley  Fighting  Veh 
12  M901  TOW  Veh 
72  Infantry  Riflemen 
18  MedATWpn 
6  FIST  Tm 
6  FIST-V 

1  OH-58D  Helicopter 


muw&ijrn 


8  Adv  FA  System 
6  M106  (4.2")  Mbrtar 


RED  SYSTEMS 


Moving 
31  T-72  Tank 
111  BMP-2 
19  BMP-1 
419  Riflemen 
81  RPG-7 
135  Lt  MG 
18  AGS-17 
9  ADATm 
24  120mm  Mtr 
24  BRDM-AT 


3  ea  T-62,  T-80,  BMP-2 
15  Riflemen 
5  Truck  Util 
2  Truck  POL 
1  BMP  Cmd  Post 
1  Motorcycle 


72  152mm  How 
18  122mm  Mortar 


20%  Soft  Targets/  80%  Hard  Targets 


High-Resolution  Force  Structure 
SWA  Mech  Infantry  Scenario  #2 


BLUE  SYSTEMS  1 


\\\\NV»N\SSV.WSViSV4*.V 


28  Ml  A1  Tank 
30  M2  Bradley  Fighting  Veh 
12  M901  TOW  Veh 
72  Infantry  Riflemen 
18  MedATWpn 
6  FIST  Tm 
6  FIST-V 

1  OH*58D  Helicopter 


Moving 
31  T-72  Tank 
111  BMP*2 
19  BMP-1 
419  Riflemen 
81  RPG-7 
135  Lt  MG 
18  AGS-17 
9  ADA  Tm 


RED  SYSTEMS 


MJrttLfJrt 
72  152mm  How 
18  122mm  Mortar 


iMCPlStptiQnery.  Mel 
3  ea  T-62,  T-80,  BMP-2 
15  Riflemen 
5  Truck  Util 
2  Truck  POL 
1  BMP  Cmd  Post 
1  Motorcycle 


fafjirttt  Fire 
8  Adv  FA  System 
6  Ml06(4.2,f)  Mortar 


24  120mm  Mtr 
24  BRDM-AT 


Atfitmal  Imsiz 

10  Trucks  : 

30  Riflemen  1/1 
|3  ;:  BRDM-AT  ill 

2  SA-13 

3  ZSU-23-4 

I  122mm  MRL 
r  2  Motorcycles 


60%  Soft  Targets/  40%  Hard  Targets 


AFAS  Variation  Levels 


Rate  of  Fire 

1.  8  rds/minute 

2.  10  rds/minute 

3.  12  rds/minute 


Time  on  Target 

1.  4-rd  volleys 

2.  6-rd  volleys 

3.  8-rd  volleys 


-  Levels  1  and  3  are  the  low  and  high  levels  for  the  Factorial  Design 

•  Level  2  (middle-level  values)  will  be  predicted  by  Response  Surface 
Methodology  and  then  compared  with  the  output  from  the  actual  runs. 


TOT  ♦  ROF 


Summary  of  DOE  Results 

Significant  Main  Effects! 


MOE 


Mission  Factor 


Look  at 
these 
MOE  for 
RSM 


Arty,  Rounds/Kill 
Direct  Fire  Kills 
Indirect  Fire  Kills 
DF  Engagement  Rg 
Detection  Ratio 
Percent  Contribution 


ROF 

TOT 

ROF 

TOT  &  ROF 
TOT 

TOT  &  ROF 


Response  Surface  Method 


Premise:  RSM  can  be  used  to  Predict  the  Effects  of  a  Simulation 

Proved  by:  Comparing  the  RSM  Values  for  Mid-Levels  in  ROF  &  TOT 
with  the  actual  averages  obtained  from  the  runs  in  Janus 

MOE  fo  Compare: 


1.  indirect  Fire  Rounds  per  Red  System  Killed 

2.  AFAS  Percent  Contribution  vice  Ml,  M2  and  M901  systems 


AFAS  Study  Conclusions 


Comparison  of  Factorial  Design  of  Experiments  Results 


1.  Increasing  the  rate  of  fire  showed  a  significant  decrease  in 
artillery  rounds  per  kill  (-0.64  rpk). 

2.  For  Indirect  Fire  Kills,  there  was  a  significant  increase  (13.1  kills) 
when  changing  from  8  rds/min  ROF  to  12  rds /  min. 

3.  AFAS  percent  contribution  significantly  Increased  in  both  methods 
of  employment  (1.62%  for  TOT  and  2.11%  on  ROF). 


AFAS  Study  Conclusions 


Response  Surface  Methodology  Results 


1.  For  both  scenarios,  predictions  of  artillery  rounds  per  kill  for 

a  TOT  of  6  rds  and  a  ROF  of  10  rds/min  were  within  the  actual  runs* 
confidence  intervals. 

2.  AFAS  percent  contribution  predictions  were  also  within  the  bounds  of 
confidence  intervals  for  the  same  cases  as  in  '1 


3.  RSM  does  show  potential  for  reducing  the  amount  of  runs  required 
for  a  study  of  parameters,  such  as  T OT  or  ROF. 


AFAS  Study  Conclusions 


Comparison  of  Graphs  &  Confidence  Intervals  about  Means  § 


1.  In  Killing  Hard  Targets,  the  12  rds/min  ROF  is  most  effective 
in  a  20%  Soft/80%  Hard  target  distribution 

2.  For  S%ft  Targets,  there  appears  to  be  no  significant  difference 
among  any  of  the  methods,  although  a  higher  ROF  or  TOT  shows 
a  larger  mean. 

3.  The  Method  of  Employment  shows  no  sigificant  effect  on 
Direct  Fire  Engagement  Ranges  even  though  the  Factorial  Design 
Analysis  suggested  minor  changes  in  effects  due  to  changing  factors. 


1000  Target  Methodology 


1.  Based  on  Soviet-style  tank  company  in  wedge  formation. 

2.  100  target  groupings;  10  vehicles  per  group. 

3.  Two  platoons  with  3  vehicles;  1  with  4  (includes  HQ  tank). 

4.  One  event  per  method  of  engagement: 

••  One  8-round  volley  per  group  under  8  TOT 
—  Twelve  rounds,  5  seconds  apart,  pergroup  under  12  ROF 


5.  ROF  rounds  are  spread  over  a  1-minute  attack. 

6.  Five  runs  for  each  method  of  engagement 

7.  Trucks  substituted  for  tanks  at  the  same  locations. 


Appendix  B 

Factorial  Design  Analysis:  TOT 
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MOE  =  Engagement  Ranges  of  Direct  Fire  Systems  for  TOT  Missions 
Block  Name:  ER_TOT 
Design  Factor 
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MOE  =  #  Indirect  Fire  Kills  of  Red  for  TOT  Missions 
Block  Name:  IDFK_TOT 
rv>«i«m  Factor 
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Appendix  C 

Factorial  Design  Analysis:  ROF 


MOE  =  Percent  Contribution  of  AFAS  for  ROF  Missions 
Block  Name:  PER_ROF 
Desicn  Factor 
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MOE  =  Detection  Ratio  for  ROF  Missions 
Block  Name:  DR_ROF 
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Advanced  Field  Artillery  System  Study 
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Appendix  D 

Response  Surface  Methodology  Calculations:  TOT 
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Surface  Methodology  Calculations  I 

1  Cocff  I  M  1  M  I  Variable  I  Indeo  E[R(TOT,TGT)]  =  Avg  Response  +  TOT  Coeff*TOT_VariabIe  +  TGT  Coeff*TGT_Vari 

" _ 4 _ 8 _ 5  -0.5  E[R(TOT=5,TGT=20%S)]  =  25.28875 

0  43075  _ 4 _ 8 _ 6 _ 0  E[R(TOT=6.TGT=20%S)]  =  25.61225 
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Appendix  E 

Response  Surface  Methodology  Calculations:  ROF 
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Appendix  F 

1000-Target  Methodology  by  SFC  West 
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.  Trucks  substituted  for  tanks  at  the  same  locations. 
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Appendix  G 

After-Action  Memo  by  MAJ  Watson  on  AFAS  Briefing 


OPERATIONS  RESEARCH  CENTER 
UNITED  STATES  MILITARY  ACADEMY 
WEST  POINT,  NEW  YORK  10996 


MADN-OR  22  July  1992 

MEMORANDUM  FOR  LTC  James  E.  Armstrong,  Director  ORCEN,  USMA 

SUBJECT:  TDY  Trip  to  Fort  Sill,  Oklahoma  concerning  the  Advanced  Field 
Artillery  System  (AFAS). 

1.  On  19-21  July  92,  CPT  Jim  Watson  went  to  Fort  Sill,  Oklahoma  to  attend  a 
briefing  by  Majors  George  Stone  and  Jay  Moughon,  and  SFC  West  of  DMI. 

Their  briefing,  which  occurred  on  20  1 300  July  92,  covered  their  work  on  the 
Janus(A)  combat  modeling  system  regarding  the  AFAS.  They  briefed  numerous 
(about  20)  civilian  and  military  personnel  of  the  Directorate  of  Combat 
Developments  (DCD),  U.S.  Army  Field  Artillery  School.  Please  see  the  attached 
listing  of  the  key  personnel  who  attended. 

2.  The  briefing  went  quite  well  with,  at  times,  very  lively  interaction  with  the 
audience  concerning  the  assumptions  and  set-up  of  the  Janus  scenarios  which  MAI 
Stone  and  MAJ  Moughon  developed.  They  seemed  very  interested  in  comparing 
the  effects  of  the  AFAS  between  the  Time-on-Target  and  Rate-of  Fire  target 
engagement  methods.  The  briefing  concluded  with  high  interest  on  the  part  of  all 
key  personnel  in  the  DCD  to  continue  with  the  analysis  with  some  refinements  on  • 
the  scenario  set-up,  as  well  as  the  modeling  of  key  AFAS  attributes. 

3.  I  would  highly  recommend  continued  work  on  this  project.  The  resulting 
analysis  would  be  well  received  by  not  only  DCD  personnel,  but  also  high  level 
Field  Artillery  and  Procurement  Action  Officers.  The  refinement  of  the 
scenarios  could  be  done  nicely  by  cadets  in  the  Janus  Combat' Modeling  Lab  as  a 
SE489  project.  In  addition,  SFC  West  informed  me  that  COL  Karr,  the  Director 
of  Military  Instruction,  was  very  interested  in  pursuing  this  project. 

4.  I  would  be  happy  to  continue  this  analysis.  As  a  Field  Artilleryman  and  an 
ORCEN  Analyst,  this  project  would  exercise  my  education  and  training  most 
appropriately. 


JamesX.  Watson,  Jr. 
CPT,  FA 
ORCEN  Analyst 


AFAS  KEY  PERSONNEL 


Mr.  Loveless 
Special  Projects 
GM-14 


